Hidden multiplicity in exploratory multiway ANOVA: Prevalence and remedies
نویسندگان
چکیده
Many psychologists do not realize that exploratory use of the popular multiway analysis of variance harbors a multiple-comparison problem. In the case of two factors, three separate null hypotheses are subject to test (i.e., two main effects and one interaction). Consequently, the probability of at least one Type I error (if all null hypotheses are true) is 14 % rather than 5 %, if the three tests are independent. We explain the multiple-comparison problem and demonstrate that researchers almost never correct for it. To mitigate the problem, we describe four remedies: the omnibus F test, control of the familywise error rate, control of the false discovery rate, and preregistration of the hypotheses.
منابع مشابه
An introduction to Multiway Methods for Multi-Subject fMRI experiment
Model free exploratory methods available for functional MRI analysis of one subject such as Principal Component Analysis (PCA) and Independent Component Analysis (ICA) are investigated for generalisations when analysing more than one subject. Introducing the subject dimension makes a three-way data: brain, time, subject, and multiway methods are proposed either to optimise the variance (PCA) or...
متن کاملCosts of Quality: Exploratory Analysis of Hidden Elements and Prioritization using Analytic Hierarchy Process
Cost of Quality analysis is emerged as an effective tool for the industrial managers for pinpointing the deficiencies in the system as well as for identifying the improvement areas by highlighting the cost reduction opportunities. However , this analysis will be fully effective only if it is further extended to identify the cost incurred in ensuring quality in all areas of the supply chain incl...
متن کاملMultiway frequency analysis for experimental psychologists.
Many research designs in experimental psychology generate data that are fundamentally discrete or categorical in nature, and produce multiway tables of frequencies. Despite an extensive and, more recently, accessible literature on the topic, multiway frequency analysis is rarely used in experimental psychology. A reason may be the form of exposition in the literature, with emphases and concerns...
متن کاملUnilateral Hearing Loss: Prevalence, Causes, Consequences and Available Remedies
Introduction: The prevalence of unilateral sensory neural hearing loss is 3 to 6 in every 1000 people and this prevalence will be about 3 to 5 percent by including conductive hearing loss. Studies have shown that people with unilateral hearing loss are having problems in speech and language development. Nowadays the available options for treatment and rehabilitation of people with unilateral he...
متن کاملSimilarity Component Analysis
Measuring similarity is crucial to many learning tasks. To this end, metric learning has been the dominant paradigm. However, similarity is a richer and broader notion than what metrics entail. For example, similarity can arise from the process of aggregating the decisions of multiple latent components, where each latent component compares data in its own way by focusing on a different subset o...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره 23 شماره
صفحات -
تاریخ انتشار 2016